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Abstract 
This randomized controlled study investigated the efficacy of a Tier 1 intervention, schema- 
based instruction (SBI), designed to help students with and without mathematics difficulties 
(MD) develop proportional reasoning. Twenty seventh-grade teachers/classrooms were randomly 
assigned to a treatment (SBI) or control (business-as-usual) condition. Participants included 373 
students of whom 253 demonstrated MD. A measure of proportional problem solving (PPS) was 
administered at pre- and post-testing, and at 11 weeks following treatment, along with a general 
mathematical problem solving measure at pre- and post-testing. For the full sample, posttest 
differences favoring the treatment group were statistically significant for all measures. For 
students with MD, posttest differences favored the treatment group for the PPS posttest and PPS 


delayed posttest, but not for general problem solving posttest. 
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Investigating a Tier 1 Intervention Focused on Proportional Reasoning: A Follow- 
Up Study 

The present Tier 1 study represents a follow-up and extension of a study conducted by 
Jitendra et al. (2015) that provided evidence of the positive impact of a research-based 
intervention, schema-based instruction (SBI), in improving middle school students’ proportional 
reasoning. The present study resembles a replication with its focus on consistency of findings, 
but sample size limitations suggest that the study represents a follow-up to Jitendra et al. (2015) 
that permits limited generalizability rather than a traditional replication. 

Several authors have pointed out that replications are a staple in methods textbooks and 
are badly needed (Makel & Plucker, 2014) but rarely appear in practice (Duncan, Engel, 
Claessens, & Dowsett, 2015). The argument for replication in educational research is simple: 
Replication is central to understanding and improving scientific research in that it decreases 
research bias by providing evidence supporting (validating) positive findings or invalidating 
false positive findings (Cook, 2014; Coyne, Cook, & Therrien, 2016; Gottfredson et al., 2015; 
Schmidt, 2009; Valentine et al., 2011). 

We conducted a follow-up study of Jitendra et al. (2015) whose features were consistent 
with a conceptual replication (see Doabler et al., 2016) which “alter[s] specific aspects of a 
previous study” (Cook, 2014, p. 234) to determine the extent to which findings generalize across 
participants, settings, and conditions (Schmidt, 2009). The follow-up study used a smaller but 
more demographically and geographically diverse sample. Jitendra et al. (2015) investigated the 
efficacy of the SBI intervention in mostly rural schools in one state in the upper Midwest using a 
sample of students and teachers that were predominantly White. In contrast, the follow-up study 


was conducted in urban and suburban schools from a metropolitan area in the Southeast using a 
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sample that was more racially diverse and included larger percentages of English language 
learners and students from economically disadvantaged backgrounds. Students in the present 
study also received instruction on ratios and proportional relationships in late October, which 
was about two months earlier than the original study (early January). 

An overarching principle in research conducted within multi-tiered systems of support 
(MTSS) or a response-to-intervention framework is that a Tier 1 intervention must be effective 
for students with mathematics disabilities or difficulties (MD) as well as for their peers without 
MD, because students with MD often receive instruction in traditional mathematics classrooms 
(Fuchs, Fuchs, & Compton, 2012). This focus is consistent with national educational policy 
embodied by the Common Core State Standards (CCSS; National Governors Association Center 
for Best Practices & Council of Chief State School Officers, 2010) in mathematics that requires 
all students to connect the standards of mathematical practice (e.g., making sense of problems, 
reasoning abstractly and quantitatively, looking for and making use of structure, and modeling 
with mathematics, and attending to precision) to the standards for mathematical content to 
develop proficiency in mathematics. Meeting these standards creates important challenges for 
students with MD and those with persistently low achievement in mathematics. For example, the 
2015 National Assessment of Educational Progress scores indicated that 68% of eighth-grade 
students with disabilities performed below basic compared with 23% of students without 
disabilities in mathematics (National Center for Education Statistics, n.d.). Thus an important 
focus of research, including ours, is to identify programs that improve these students’ 
mathematics achievement. 

One mathematics topic of particular importance in the middle grades is proportionality, 


which involves the concept of ratio and is central to topics in mathematics such as linear 
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functions, scale drawings, similarity, trigonometry, and probability. Ratio and proportional 
relationships, along with the interrelated topics of fractions, decimals, and percent, provide a 
critical foundation for algebra (National Mathematics Advisory Panel [NMAP], 2008). Students 
in the middle grades are expected to “develop understanding of proportionality to solve single 
and multi-step problems ... solve a wide variety of percent problems, including those involving 
discounts, interest, taxes, tips, and percent increase or decrease” (CCSS, 2010, p. 46). 
Proportional reasoning, which not only requires understanding the concept of ratios and that two 
or more ratios are equal, also requires the ability to extract relevant information to develop a 
representation of the problem situation and is challenging for many children and adolescents 
(Ozgun-Koca & Altay, 2009). As such, it seems reasonable to provide effective core (Tier 1) 
classroom instruction to all students before providing more intensive (Tier 2 and Tier 3) 
interventions to students who do not respond to classroom instruction (National Center on 
Response to Intervention, n.d.). Determining whether students who do not respond to Tier | 
instruction need Tier 2 services or just better Tier 1 instruction is an important challenge (Fuchs, 
Fuchs, & Vaughn, 2008). 
Tier I Instruction in Proportional Reasoning that Meets the Needs of Students With and 
Without MD 

Four randomized controlled Tier 1 studies (Jitendra et al., 2015; Jitendra et al., 2009; 
Jitendra, Star, Dupuis, & Rodriguez, 2013; Jitendra, Star, Rodriguez, Lindell, & Someki, 2011) 
have examined the effectiveness of the SBI intervention in improving students’ proportional 
reasoning, three of which reported results separately for students with and without MD. Two of 
the three studies found evidence of effective proportional problem solving instruction for 


students without MD that was also effective for students with MD. 
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In Jitendra et al. (2009) and Jitendra and Star (2012), eight seventh-grade classrooms 
were randomly assigned to SBI or a “business as usual” control condition and received 
instruction five times a week for 45 min over a 2-week period on the topics of ratio and 
proportion or percent. Jitendra et al. (2009) found that students in the SBI condition, on average, 
scored higher than students in the control condition on the proportional problem-solving test and 
maintained the effects on a 4-month retention test. However, the results also showed that scores 
of low achieving students in the SBI group were comparable to those of low achieving students 
in the control group. Similar findings were reported by Jitendra and Star (2012). In a follow-up 
study, Jitendra et al. (2013; see also Jitendra, Dupuis, et al., 2016) included more classrooms and 
found that posttest and retention test (6 weeks later) differences favoring the SBI group were 
significantly different for students with and without MD. On a transfer measure that included 
items not directly aligned with the taught content there were no intervention effects. 

A recent randomized study (Jitendra et al., 2015; see also Jitendra, Harwell, Dupuis, & 
Karl, in press) made methodological improvements by randomly assigning 82 teachers to SBI or 
control conditions, and randomly selecting one classroom for each teacher to participate in the 
study meaning that each teacher taught in a single SBI or control classroom. Findings comparing 
the SBI and control conditions in Jitendra et al. (2015) were reported for all students (1.e., 
students with and without MD) and for MD students only (Jitendra et al., in press). In both 
instances SBI classrooms outperformed control classrooms on the posttest and maintained the 
effects nine weeks following the end of the study. Multilevel standardized effect sizes for all 
students and students with MD on the posttest were .46 and .32; on the retention test 
administered 8 weeks later the effect sizes were .32 and .25. Results for the full sample indicated 


that students in SBI classrooms showed more growth on proportional problem solving than 
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students in control classrooms; this finding was not statistically significant for students with MD. 
There were no intervention effects on a standardized test that assessed overall mathematical 
problem solving involving multiple content areas (e.g., algebra, geometry). 
The Present Study 

The present study focused on increasing confidence and generalizability of findings to 
support the impact of the SBI intervention when implemented in a geographically diverse 
location with a more demographically diverse sample. The research questions were as follows: 
la. What are the effects of the SBI intervention compared to business-as-usual instruction on 
students’ proportional problem solving at immediate posttest and after 11 weeks? 1b. Does SBI 
moderate students’ learning trajectory over time? 1c. What are the effects of the SBI intervention 
compared to business-as-usual instruction on students’ general mathematical problem solving? 
2a. What are the effects of the SBI intervention compared to business-as-usual instruction for 
students with MD on proportional problem solving at immediate posttest and after 11 weeks? 2b. 
Does SBI moderate the learning trajectory of students with MD? 2c. What are the effects of the 
SBI intervention compared to business-as-usual instruction for students with MD on general 
mathematical problem solving? 

Method 

Recruitment Procedure 

Following Institutional Review Board approval, the proposed research study was 
presented to middle school principals, curriculum specialists, and math coaches at a meeting in a 
Southeast U.S. district in the spring prior to the academic year in which the study occurred. 
Middle school math teachers received information about the study via presentations and a 


newsletter from their principal and the Director of Secondary Curriculum and Instruction. To 
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meet study inclusion criteria teachers were required to be responsible for teaching at least one 
seventh-grade math class, agree to randomization, administer mathematics measures to assess 
student learning, and allow videotaping to assess fidelity of treatment implementation. Once 
teachers provided written consent one class for each teacher was selected at random to 
participate in the study. The 22 teachers that consented and their participating class were 
randomly assigned to the SBI condition or to a control condition that received business-as-usual 
instruction. Following random assignment two teachers assigned to the control group were 
eliminated from the study because they did not teach a typical seventh-grade math class (i.e., 
taught advanced 7" grade content), resulting in unequal numbers of teachers in the treatment (j = 
11) and control (j = 9) conditions. 
School Context and Participants 

The 10 middle schools participating in the study were part of a district in a metropolitan 
area with an approximate student enrollment of 193,000. Participating schools ranged in size 
from 907 to 1807 students. Most schools in the sample (90%) were located in urban settings 
while one school was located in a suburban setting. 

Students. The initial student sample consisted of 429 seventh-graders but was reduced to 
373 (87% of the original sample) because 56 students had missing demographic data. The 
remaining 373 students constituted the sample used in our analyses and represented a more 
diverse sample than that used in prior evaluations of SBI (Jitendra et al., 2015). Among students 
the racial group sample sizes were Hispanic (143/373 = 38.3%) followed by Black (31.4%), 
White (23.6%), Asian (3.8%), and multiracial (2.9%). The mean age of the students was 12.7 
years (SD = .55). Approximately 73% of the sample was eligible for a free or reduced price 


lunch, 6.2% received special education services, and 23.9% were English language learners. 
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Two hundred and fifty three students (67.8% of the sample) were classified as having 
mathematics difficulties (MD) based on end-of-the-year 6" grade state mathematics achievement 
assessment. Precise reasons for the large number of students with MD in the sample are 
unknown but may be related to characteristics of the state mathematics test used to categorize 
students as having MD, as well as the fact that all sampled schools received Title I assistance 
(see Bottge et al., 2014). Achievement levels on this test were | (lowest = inadequate), 2 (below 
satisfactory), 3 (satisfactory), 4 (above satisfactory), or 5 (highest = mastery). Students whose 
achievement level was inadequate (117, 32.2%) or below satisfactory (136, 37.5%) met the 
criterion for mathematical difficulties (i.e., low average performance on the state math 
achievement test) and were classified as having MD and those scoring > 3 as without MD. 

Teachers. The 20 participating seventh-grade mathematics teachers’ mean years of 
experience was 7.05 (SD = 5.42, range 2 to 19 years). All teachers were certified to teach 
mathematics while 5% were also certified to teach science, 20% were certified in subjects other 
than mathematics or science, and 25% were certified in all subjects (generalist). Similarly, all 
teachers were certified to teach grades 6-8, 35% were certified to teach grades 9-12, and 35% to 
teach grades K-5. The majority of teachers were White (70%), with three Black, two Asian, and 
one Hispanic teacher. Seventy percent of teachers were female. One teacher (5%) taught in a 
large suburban setting and the remaining teachers (95%) in urban settings. Student and teacher 
demographic characteristics in the SBI and control groups are presented in Table 1. 

Study Design 

We used a prospective randomized cluster design with longitudinal data (pretest, posttest, 

delayed posttest) in which teachers/classrooms served as clusters. If properly implemented, this 


design ensures that estimated treatment effects are unbiased (Bloom, Richburg-Hayes, & Black, 
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2007). An a priori power and sample size analysis using the Optimal Design software (Spybrook 
et al., 2011) was performed that focused on testing the SBI vs. control effect for cross-sectional 
data needed to answer the research questions. The results indicated that 20 clusters, 373 students, 
and an intra-class correlation of .15 (Hedges & Hedberg, 2007) provide a power of .74 to detect a 
standardized effect of .55 (a moderate effect following Cohen, 1988) for the SBI vs. control 
comparison. This effect size is consistent with that reported by Jitendra et al. (2015). 
Procedures 

Teachers implemented two instructional units (Ratio and Proportion; Percent) in their 
treatment and control classes using the assigned curricular program in late October, after the 
pretest had been administered. The two units were implemented 45 minutes daily for 6 weeks. 
Control teachers used their district-mandated textbook and typical practices to teach the content 
(i.e., ratio, proportion, and percent), whereas treatment teachers used the SBI curriculum to teach 
the same content over the same time period. 

Treatment teachers received 2 days (16 hr) of professional development (PD) training 
prior to the start of the study in early October. The training was conducted by a researcher 
outside of the research team who was an expert in problem solving and PD training and was 
familiar with the SBI intervention. The primary purpose of the training was to familiarize 
teachers with the SBI curriculum by explaining the background and principles of the SBI 
program and discussing all materials as well as the planning and organization of the lessons. The 
training also covered SBI practices (e.g., recognizing problem types, generating estimates, 
applying multiple-solution strategies) used to support student learning of ratio, proportion and 
percent. There was a significant focus on SBI implementation, which involved not only reading 


the detailed scripts on when and how to implement SBI practices but also viewing multiple short 
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video clips in which other teachers demonstrated the application of the SBI practices in their 
classrooms. 

Description of the SBI intervention. Several features underlie the SBI intervention, 
including recognizing the mathematical structure of problems, using visual representations to 
model the problem, applying problem solving procedures for a given class of problems, and 
developing procedural flexibility . Also integral to SBI is monitoring and reflecting on the 
problem solving process. These practices parallel the mathematical practices (e.g., look for and 
make use of structure, model with mathematics) in the CCSS and are consistent with the 
recommendations articulated in the What Works Clearinghouse’s research synthesis on 
improving students’ mathematical problem solving performance (Woodward et al., 2012). In 
addition, the SBI intervention incorporates several instructional features (e.g., explicit and 
systematic instruction, scaffolding instruction with guided questions to help clarify and refine 
student thinking) that are important to promoting problem solving for students with MD 
(Gersten, Beckmann, et al., 2009; Gersten, Chard, et al., 2009). 

The SBI program materials include a detailed teacher guide and other resources (e.g., 
visual diagrams, problem solving checklists, homework answer key) to support teachers in 
implementing activities to develop critical concepts and skills, as well as student materials (i.e., 
workbook and homework book). The program is comprised of 21 lessons that can be completed 
in about 30 days (some lessons take more than a day to implement) with the first unit focusing on 
Ratio/Proportion (e.g., equivalent ratios, rates, ratio and proportion word problem solving, scale 
drawings), and the second unit on Percent (e.g., percent increase or decrease, including those 
involving discounts, interest, taxes, tips). Instruction included both whole class instruction as 


well as partner work using a Think/Plan-Share strategy to enhance students’ critical thinking. 
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Each unit includes nine lessons and a culminating lesson that evaluates student knowledge of 
material covered. These lessons present real-world scenarios (i.e., designing a recording studio, 
constructing a digital planetarium) and require students to work in small groups to solve several 
problems involving ratios and proportional relationships. Lesson 21 culminated with a review of 
the content from both units. Mid- and end-of-unit tests are used to check content understanding 
and evaluate student progress in the SBI program. 

The SBI intervention consists of four instructional practices: (a) problem structure 
identification, (b) problem representation using schematic diagrams, (c) procedural flexibility, 
and (d) problem solving and metacognitive strategy knowledge application. The problem solving 
and metacognitive strategy knowledge application practice allows students to apply learned 
content (e.g., ratios/rates, percent) in problem solving activities: (a) recognize the problem type, 
(b) connect the problem to what is already known, (c) identify and represent critical information 
in the problem using an appropriate diagram, (d) estimate the answer, (e) select a strategy to 
solve the problem, (f) solve and present the solution within the context of the problem, and (g) 
check the reasonableness of the solution. Further, metacognitive activities include monitoring 
and reflecting on the problem-solving process (e.g., when, how, and why to use multiple 
strategies —equivalent fractions, unit rate, cross multiplication — for a given class of problems) 
(For further details of the SBI program, see Jitendra et al., 2015; Jitendra et al., 2009, 2011, 
2013). Instruction in applying SBI practices to support student learning was scaffolded such that 
teachers initially modeled problem solving by thinking aloud and gradually shifted responsibility 
to the students, with teachers using explicit prompts to help clarify and refine student thinking. 

“Business as usual” control instruction. Students in the control condition received 


instruction on the same topics and in the same time period as the treatment condition. Control 
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teachers used the district-adopted mathematics textbook (Go Math! Florida, Adams et al., 2011) 
to introduce the topics of ratio, proportion, and percent by using various tips to “motivate the 
lesson (e.g., “Have you ever measured how far you can walk in 15 minutes?”),” “focus on 
patterns” (e.g., use number patterns to complete a table and use the pattern to calculate distance), 
and “connect vocabulary” (rates and ratios). In general, instruction in the control classrooms 
differed on a number of important aspects from the SBI program. Although ratio, proportion, and 
percent lessons in the control textbook focused on a specific type of problem (e.g., rates, percent 
of change), opportunities for teachers to focus on identification of problem structure or 
emphasize how the problem was similar or different from a previously solved problem was 
lacking. The control textbook presented several visual representations (e.g., tables, graphs, bar 
diagrams). Worked examples in the textbook focused on modeling the problem solving steps and 
instructions were included to use questioning strategies (e.g., “What characteristic do you look 
for in the table in order to decide whether the relationship is proportional?”). However, the 
opportunities to apply these practices were limited to one or two examples. Within the context of 
problem solving, an emphasis on multiple solution and estimation strategies was nonexistent. 
Measures 

Proportional problem solving (PPS) and general mathematical problem solving 
assessments were administered prior to (early October), and immediately following the 
intervention with retention of PPS data collected 11 weeks following intervention. We also 
collected students’ sixth-grade scores on a state-mandated mathematics assessment as well as 
student race, sex, special education, ELL, and FRL status. In addition, all teachers completed the 
Mathematical Knowledge for Teaching (MKT) test online prior to the start of the study to 


establish baseline estimates of teachers’ knowledge for teaching proportional relationships. MKT 
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was developed as part of the Learning Mathematics for Teaching Project (LMT) at the 
University of Michigan to assess the specific mathematics content knowledge teachers need to 
know (Hill, Ball, Blunk, Goffney, & Rowan, 2007). We used the Grade 4-8 proportional 
reasoning measure, which consists of two equivalent forms A and B of 15 and 16 multiple- 
choice and multi-step questions, including applied word problems. The measure takes about 30 
minutes to complete. We report item response theory-based scores for the MKT that take into 
account the relative difficulty of items. 

Proportional problem-solving (PPS) test. The PPS test (Jitendra et al., 2015) was used 
to assess proportional problem solving. The PPS has been used in previous studies and consists 
of 22 multiple-choice questions and four short-response items. Multiple-choice items were 
dichotomously scored (correct, incorrect), whereas short answer items were scored 0-to-2 by 
trained research personnel who were unaware if a student was in treatment or control using a 
rubric which emphasized correct reasoning. We estimated average inter-rater reliability for the 
short answer items using an intra-class correlation, which produced values of 0.90, 0.92, and 
0.90 at pretest, posttest, and delayed posttest, respectively. 

Student scores on the PPS were calculated by computing the sum of the total points 
earned (i.e., 30) meaning that the short-response and multiple-choice items contributed unequally 
to the overall score. We assessed the internal consistency of the PPS using the jMetrik software 
(Version 2.1.0; Meyer, 2011) and fit a congeneric model assuming a single continuous latent 
factor underlies the dichotomous- and trichotomously-scored PPS items (McDonald, 1999). The 
coefficient omega (Dunn, Baguley, & Brunsden, 2013) values for the PPS pretest, posttest, and 
delayed posttest of 0.76, 0.82, and 0.80, respectively, represent reliabilities estimated as the ratio 


of true score variance to observed score variance (Dunn et al., 2013). 
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Group Mathematics Assessment and Diagnostic Evaluation (GMADE). The Process 
and Applications subtest of the GMADE (Pearson, 2004) is a group-administered, untimed 
assessment of general problem solving. This measure consists of 30 multiple-choice questions, 
including multiple-step problems and process problems, and assessed students’ ability to 
comprehend mathematical language and concepts and apply relevant operations to solve word 
problems across multiple content areas (e.g., algebra, geometry, number and operations). Each 
question was awarded one point if correct. The coefficient omega reliabilities for our sample 
were ().74 for the pretest and 0.75 for the posttest. 

Fidelity of implementation 

We collected data on proportion problem solving instruction in the treatment and control 
classes by videotaping each teacher’s class and then coding the extent to which the SBI treatment 
was implemented with fidelity and whether SBI instructional practices (identifies the problem 
type, connects the new problem to previously solved problems, represents critical information in 
the problem text using an appropriate diagram, generates an estimate prior to solving the 
problem, discusses multiple solution strategies, presents the solution within the context of the 
problem, checks the solution) were implemented in control classes. Research team members 
utilized a rubric used in prior studies (e.g., Jitendra et al., 2015) to rate the classroom instruction 
using a 0-3 point scale (0 = did not implement to 3 = high level of implementation). Fidelity for 
each classroom was independently assessed by two of the four coders producing 40 ratings (two 
per classroom). Disagreements in ratings were resolved through discussion and review of the 
videotapes. We estimated inter-rater reliability by computing intra-class correlations for the 


ratings, which averaged 0.94 (range 0.87 to 0.99). 
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We conducted t-tests to test group differences on the fidelity of implementation data and 
used the Dunn-Bonferroni correction to control for compounding of Type | error. Results 
indicated statistically significant and fairly substantial differences between the treatment (M = 
14.45, SD = 4.13) and control groups (M = 9.00, SD = 4.18) on the total fidelity score (4(18) = 
2.92, p = .009, ES = 1.31) and on item 4 (i.e., generates an estimate prior to solving the problem) 
(t(18) = 3.92, p <.001, ES = 1.76), with treatment teachers (M = 1.91, SD = 1.14) implementing 
this SBI element more than control teachers (M = 0.22, SD = 0.67). 

Data Analysis 

To assess differences between treatment and control conditions we fitted a series of 
multilevel (i.e., two-level, students within classrooms) models with covariates at both levels 
using the HLM 6 software (Raudenbush, Bryk, & Congdon, 2004). Adjusting the outcomes 
using control variables can account for variation that may improve statistical power (Bloom et 
al., 2007). The outcome variables were the PPS posttest, PPS delayed posttest, and GMADE 
posttest, which were analyzed separately. We also performed an analysis of the PPS longitudinal 
data to explore student change over time and whether change was moderated by the treatment. 

For each outcome the Level | (student) model contained the following covariates: pretest 
score, sex (0 = males, 1 = females), race (Black = 1, Hispanic = 1, Asian = 1, Multiracial = 1, 
and White = 0, so the latter served as the reference group), and math achievement level 
(Inadequate = 1, Below Satisfactory = 2, Satisfactory and Above = 3; Inadequate and Below 
Satisfactory math achievement levels were used to select students with MD). All Level 1 
covariates were grand-mean centered. Level 2 covariates included the treatment variable (1 = 
SBI, 0 = control), two teacher variables (i.e., years of teaching experience in mathematics and 


MKT proportional reasoning IRT score), and variables capturing the percentage of the following: 
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English language learners (ELL), students eligible for free or reduced price lunch (FRL), and 
students receiving special education services per classroom or teacher. We focused on classroom 
ELL, FRL, and special education because these variables sometimes showed little or no variation 
in a classroom at the student level. Because the classroom distributions of the percentages were 
ragged and discontinuous, we rescaled the ELL and FRL variables to quartiles and the special 
education variable into a trichotomy and used the rescaled versions as Level 2 covariates. 

Slopes capturing the impact of student variables (e.g., sex) on the outcome variables did 
not vary significantly across classrooms (i.e., variance = 0). Thus, models examining the impact 
of treatment on Level | relationships were not fitted and in what follows the results are based on 
intercepts-only models. We also examined the data for evidence that model assumptions were 
satisfied and found no major violations. To control for compounding of Type I error rates several 
methods are available (What Works Clearinghouse, 2014). We used the Dunn-Bonferroni 
correction in which an overall experiment-wise Type I error rate (a = .15) is divided among all 
statistical tests linked to each outcome variable with no requirement that the error rate be divided 
equally. Accordingly, we assigned .05 to the test of the treatment effect because this was the 
most important effect in the model and because this is consistent with our focus on identifying a 


program that can potentially improve the mathematics achievement of students. The remaining 
.10 was divided equally among tests of the remaining fixed effects producing ~ = = =.008. 


Impact of Missing Data 

The percentage of missing data for the PPS pretest, posttest, delayed posttest, and 
GMADE pretest and posttest among the N = 373 students was 2.5%, 4.2%, 9.7%, 3.9%, and 
5.1%, respectively. The only other missing student data occurred for math achievement level 


(2.8%). Importantly, the percentage of missing data was approximately equal in the SBI and 
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control conditions. However, the potential biasing effect of missing data (What Works 
Clearinghouse, 2014) prompted us to assess its impact. 

Because students with missing data in the multilevel analyses were omitted by the HLM6 
software, it is important to explore the sensitivity of the findings to missing data. As a sensitivity 
analysis we fitted each of the final multilevel models to the student sample that provided 
complete data (309 or 83% of the sample of 373) and compared the results to those obtained 
using all available data (some missing data). The results of these models did not differ in any 
significant way, suggesting that our models were relatively insensitive to the presence of missing 
data. As such, we used all available data for our sample of NV = 373 students for the analyses 
meaning that student sample sizes varied across analyses. The sample of teachers produced 
complete data. 

Results 
Descriptive Results 

We initially performed a series of descriptive analyses that included examining the 
correlations between all measures and exploring pre-existing differences between the SBI and 
control students. Results of the correlational analyses showed that correlations between the PPS 
pretest and posttest, pretest and delayed posttest, and posttest and delayed posttest were 0.58, 
0.57, and 0.67, respectively. The correlation between the GMADE pretest and posttest was 0.46, 
and correlations between the PPS and the GMADE tests ranged from 0.41 to 0.61 across time 
points. 

Table 2 reports means and SDs for the treatment and control groups for each measure for 
the sample of V = 373 students. Differences between the treatment and control groups on the 


PPS and GMADE pretests were statistically significant (d = -.38 SD, d= -.35 SD). For the MD 
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sample in Table 2, the treatment group scored lower than the control group on the PPS pretest (d 
= -.41) but not the GMADE pretest. It is not clear what the source of this difference is but the 
inclusion of the pretest variables as covariates in the multilevel analyses means outcomes will be 
adjusted for these differences. 

Question 1: Tests of Treatment Effects on Outcomes for All Students 

We examine the first research question involving the effects of SBI for the following 
outcomes: proportional problem solving at immediate posttest and after 11 weeks, students’ 
learning trajectory over time, and general mathematical problem solving. To estimate the intra- 
class correlation (ICC) we fitted unconditional two-level (students-within teachers/classrooms) 
models separately for the PPS posttest, PPS delayed posttest, and GMADE posttest. The ICC 
was .36 (p < .001) for the PPS posttest and .41 (p < .001) for the PPS delayed posttest, indicating 
that 36% and 41% of the variance of these variables was between classrooms. For the GMADE 
posttest the ICC = .30. We then fitted a model with student background variables and a pretest at 
Level | and teacher covariates plus the SBI treatment at Level 2 separately to each outcome 
variable. 

Tables 3, 4, 5 present the multilevel results for the PPS posttest, PPS delayed posttest, 
and GMADE posttest outcomes. Table 3 shows that SBI was a significant predictor of PPS 
posttest and that SBI students on average scored 2.25 points higher than control students 
(conditional on the model). Equivalently the SBI vs. control difference was .63 SD or 74% of 
SBI students scored above the mean of control students. Teacher MKT score was also a 
significant predictor as was FRL, with the latter interpreted to mean that each quartile increase in 
FRL rates was associated with a 1.35 point decline on the PPS posttest. Among student 


covariates Math Achievement Level was significant as well as the PPS pretest, with the former 
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interpreted to mean that each one unit increase in Math Achievement Level was associated with 
an expected gain of 1.88 points on the posttest. 

Table 4 shows that SBI was a significant predictor of the delayed posttest and that on 
average SBI students scored 1.14 points higher on the delayed PPS posttest than control students. 
Equivalently the SBI vs. control difference was .33 SD or 63% of SBI students scored above the 
mean of control students. FRL was also a significant predictor. At the student level the 
significant predictors were pretest and Math Achievement Level. 

To examine the impact of SBI on students’ growth we fitted a two-level (repeated 
measures within students) model to the PPS data assuming heterogeneity of variance over time. 
Given the exploratory nature of this analysis the only predictor in this model beyond time was 
treatment. The average linear slope over time was significant (B = .63, t= 3.41, p < .001) 
meaning that student scores on average increased over time. The results also indicated that the 
treatment variable was a statistically significant predictor of student linear growth (B = .73, t= 
3.02, p = .003), meaning that SBI students improved at a faster rate than control students. 

For the GMADE posttest Table 5 shows that SBI was a significant predictor with an SBI 
vs. control difference of .32 SD or 63% of SBI students scored above the mean of control 
students. The only significant student predictors were pretest and Math Achievement Level. 
Question 2: Tests of Treatment Effects on Outcomes for Students with MD 

We also conducted subgroup analyses that focused on the effects of SBI for a sample of 
students with MD. Preliminary analyses of the PPS posttest, PPS delayed posted, and GMADE 
posttest outcomes separately produced ICC’s of .18, .19, and .19, respectively (all p < .001). The 
number of classrooms for these analyses involving only MD students was 19 because one 


classroom had no students with MD and was omitted. 
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The MD-only results in Tables 3, 4, and 5 follow the same pattern as those described 
above. Results for the PPS posttest in Table 3 show that SBI was a significant predictor with an 
SBI vs. control difference of .51 SD or 70% of SBI students scored above the mean of control 
students. Math Achievement Level and pretest were both significant student predictors. 

The results for the PPS delayed posttest in Table 4 indicate that SBI was again a 
statistically significant predictor with an SBI vs. control difference of .35 SD or 64% of SBI 
students scored above the mean of control students. Pretest and math achievement level were 
also significant predictors. The longitudinal analysis for the MD sample showed a somewhat 
different pattern from the full sample. The average linear slope was not statistically significant (B 
= 42, t = 1.86, p = .062) (there was still significant variability among student linear slopes), but 
treatment was a significant moderator of change over time with SBI students improving at a 
faster rate than control students (B = .93, t= 3.23, p = .002). Treatment was not a significant 
predictor for the GMADE posttest in Table 5, but once again pretest and Math Achievement 
Level were significant predictors. 

Discussion 

Previous research has demonstrated the benefits of SBI for middle school students who 
were predominantly White and enrolled in schools located mostly in rural settings in the 
Midwest (Jitendra et al., 2015). This study followed-up and extended previous results regarding 
the effects of SBI in schools using a sample from a metropolitan area in the Southeast U.S. that 
was more racially diverse and included larger percentages of English language learners and 
students from economically disadvantaged backgrounds. Also, the onset of the intervention in 
the present study occurred earlier in the school year (late October) compared to the original study 


(early January). 
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Overall, we again found that SBI is effective in enhancing proportional learning, as was 
found in previous studies (e.g., Jitendra et al., 2015; Jitendra et al., 2009, 2011, 2013). Our first 
research question asked if SBI had a positive effect on proportional problem solving and general 
mathematical problem solving outcomes for all students. The results showed that the SBI 
condition outperformed the control condition on PPS and that the effect was still present at the 
11-week follow-up for PPS, providing evidence that SBI improves long-term retention of 
proportional problem solving skills. The effect sizes for the PPS posttest and delayed posttest 
were g = 0.63 SD and g = .33 SD. Furthermore, the learning trajectories of the SBI and control 
conditions were significantly different in that the rate of improvement for SBI students was faster 
than that of control students. This finding is similar to that found in Jitendra et al. (2015) and is 
noteworthy because the control condition covered approximately the same instructional topics as 
SBI and thus had the same advantage on the PPS assessment, which assessed proportional 
reasoning. Therefore, these results provide strong evidence of the superiority of SBI over 
instruction in the control condition in supporting student learning of ratios and proportional 
relationships. In both the present study and the original Jitendra et al. (2015) study, students in 
SBI classrooms learned the content more effectively than control students, which can be 
attributed to SBI practices such as using visual representations to highlight the underlying 
problem structure, engaging in problem solving and metacognitive activities, and developing 
procedural flexibility. 

We also examined the overall mathematical problem solving performance of the SBI and 
control conditions. Contrary to findings in prior SBI studies (Jitendra et al., 2015; Jitendra et al., 
2009, 2011, 2013), we found that SBI outperformed the control condition on the GMADE 


assessment (g = 0.32) even though only one-third of the GMADE items reflect concepts taught 
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in the study. One explanation for this effect could be Wagner’s (2006) theory of transfer-in- 
pieces, which highlights the importance of multiple examples necessary for “the incremental 
growth, systematization, and organization of knowledge resources that only gradually extend the 
span of situations in which a concept is perceived as applicable” (p. 10). The SBI program 
provides multiple examples and emphasizes the critical features of the various problem types to 
effect transfer of learning. At the same time, it is not known what attributes of SBI made a 
difference and positively affected the transfer of student knowledge in this study and not in 
previous studies. Nor do we know whether the benefits of SBI are enhanced when the 
intervention is delivered earlier in the school year rather than later. Further, the improved 
performance on the GMADE could be largely due to those items reflecting concepts taught in 
the study but because item-level responses are unavailable it is impossible to be sure. 

Our second research question focused on the effects of SBI on problem solving outcomes 
for students with MD. The subgroup analysis showed a pattern of short- and long-term 
advantages for students with MD in SBI classrooms similar to that for the full sample on the 
PPS. The effect sizes for the PPS posttest and delayed posttest were g = 0.51 and g = 0.35. The 
pattern of immediate and delayed benefits also corresponds to the short-term and retention 
effects observed in prior SBI studies with students with MD (Jitendra et al., in press; Jitendra, 
Dupuis, et al., 2016). Although there was substantial variability among student linear slopes, 
contrary to the finding in Jitendra et al. (in press) our results showed that SBI students 
demonstrated significantly more growth on the PPS relative to control students. 

However, similar to Jitendra et al. (in press) there was no effect on the GMADE but the 
effect size of g = 0.26 is non-negligible (see WWC, 2014), and the lack of statistical significance 


may be attributable to the modest number of classrooms. Substantively, it is possible that SBI 
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did not enable students with MD to adequately transfer the knowledge they had acquired to solve 
novel problems and that these students need more time and support to show gains in flexible 
knowledge of procedures for solving a wide range of problems. This study provides preliminary 
evidence that ambitious mathematics practices need to occur over a longer period of time for 
students with MD than their general education peers within the context of the current “Common 
Core” framework of high standards to effectively impact transfer of knowledge to a new domain. 
Previous research (Jitendra & Star, 2012) suggests this explanation is plausible. 

Overall, the findings suggest that teacher time dedicated to proportional problem solving 
did not impede general mathematical problem solving achievement of students. In fact, 
mathematical problem solving was enhanced for the whole sample. This is an important finding 
in that we found positive effects on the GMADE that contrasts with the findings of Jitendra et al. 
(2015) for all students. Also notable is that the effects sizes for all students and students with MD 
on the PPS posttest exceeded the effects (g = 0.63 vs. 0.46; g = 0.51 vs. 0.32) obtained in Author 
et al. (2015, in press). Interestingly, effect sizes for all students and students with MD on the 
delayed posttest were comparable, even though the retention test was completed 11 weeks after 
the posttest in this study rather than 8 weeks later as in Jitendra et al. (2015, in press) (g = 0.33 
vs. 0.32; g = 0.35 vs. 0.25). It is possible that the benefits of the intervention are enhanced when 
delivered earlier in the school year, but further controlled studies are needed to replicate the 
present results to determine whether proportional problem solving should be taught earlier in the 
school curriculum. 

Our findings also highlight the importance of disaggregating research findings when 
evaluating the effects of instructional programs. While SBI generally improved proportional 


problem solving for all students in the sample, the effect for overall mathematical problem 
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solving was not found for students with MD. It is possible that students with MD may have 
different instructional needs (beyond what is provided in Tier I) than other students in overall 
mathematical problem solving. However, further investigations must determine whether more 
intensive instruction (e.g., more time, small group instructional arrangement) would be 
advantageous and if so, how long the intervention should last and what should be the size of the 
instructional group. 
Implications for Practice 

Findings from the current study and prior SBI studies provide strong evidence that the 
SBI curriculum can be used within the MTSS framework in a preventative fashion to meet the 
needs of all students, including students who struggle to develop mathematical proficiency. With 
the increased implementation of MTSS there is a need for empirically validated interventions in 
mathematics, especially Tier 1 interventions, to meet the instructional needs of a range of 
learners. Specifically, addressing the needs of struggling students is critical because these 
students may need subsequent Tier 2 or Tier 3 instruction, and it would be inappropriate to place 
students in Tier 2 if there is no evidence to suggest they had the opportunity to learn from well- 
designed Tier 1 instruction. 

Ensuring that all students, including students at risk for MD, meet the Common Core 
State Standards has important implications for policy makers and teachers. For example, this 
implies that not only is it important to have strong Tier 1 programs to help students meet the 
expectations of the CCSS, but also that teachers need a deep understanding of ratios and 
proportions and problem solving as well as an understanding of what makes it difficult for 
students and how they can scaffold appropriate strategies for improving learning. However, 


many teachers are not well prepared to teach mathematics (Krauss et al., 2008), especially 


PROPORTIONAL PROBLEM SOLVING 26 


problem solving in that they often fail to discuss “what strategies students used to solve the 
problems or whether the solutions can be justified” (Woodward et al., 2012, p.6). Teachers in 
this study were provided guidance in teaching proportional problem solving (e.g., selecting a 
strategy based on the numbers in the problem, checking whether the answer is reasonable), in 
order to reach a wide range of students. Consequently, it is important that teacher training 
translates to teachers helping struggling students make sense of their reasoning related to 
proportions, which is critical for students to succeed in algebra and meet the demands of an 
increasingly competitive workplace where the demand for mathematics-intensive science and 
engineering jobs are outpacing overall job growth three-to-one (NMAP, 2008). 
Limitations and Future Research 

One limitation of the current study is the modest numbers of classrooms and students, as 
well as the large number of students with MD, which speaks to the need to further replicate SBI 
results using a larger sample in a controlled study. A forthcoming study will provide additional 
evidence of generalizability using large samples obtained from different geographic locations 
and that accurately reflect the prevalence of students with MD in schools. Another potential 
limitation in this study is that fidelity was addressed by evaluating one videotaped lesson on ratio 
problem solving. Given the relatively brief period of the intervention (six weeks) one video- 
recorded observation may provide a representative sample of participant functioning 
(Breitenstein et al., 2010). However, teachers’ fidelity of implementation in this study may have 
been affected by the selection of the lesson, which was the second lesson on word problem 
solving in Unit 1 on Ratio and Proportion. Using new instructional materials initially may also 
have been challenging for the treatment teachers. For example, the majority of the teachers did 


not emphasize how the problem was similar or different from a previously solved problem. 
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A third limitation is a plausible novelty effect in that SBI teachers in this study and 
Jitendra et al. (2015) may have been motivated by the new approach, resulting in changes in their 
teaching practices that positively impacted their student outcomes. However, the novelty effect 
may be less of an issue given the similar results across the two studies. Further, we have 
demonstrated in another study (Jitendra, Harwell, et al., 2016) the attenuation of the novelty 
effect given the sustainability of SBI when implemented by SBI-experienced teachers as 
compared to SBI-novice teachers. In this study, SBl-experienced teachers implemented SBI with 
fidelity in subsequent years without additional PD and the effects for their students on the 
mathematics outcomes were comparable. Another limitation is the significant difference between 
the treatment and control conditions on the GMADE and PPS pretests despite randomization. 
However, the inclusion of pretest as a covariate in the modeling should eliminate or minimize 
bias resulting from pre-existing differences when comparing treatment and control conditions for 
both cross-sectional and longitudinal data. 

Conclusions 

The results of the current study support the view that SBI improves proportional problem 
solving for students with and without MD. SBI, with its emphasis on the underlying problem 
structure and categorization of problem types, visual representations, and instructional strategies 
(problem solving, metacognition, multiple solution) accompanied by explanations, seems to 
enhance performance by facilitating transfer of knowledge to solve novel problems. As such, 
integrating these strategies with mathematics content is important in connecting mathematics 


practices to mathematical content articulated in the CCSS (2010). 
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Table 1. 


Participant Demographic Information by Treatment 


SBI Control 
n % n % 
Student Information — Full Sample 
Age in years M (SD) 12.73 (0.55) 12.69 (0.55) 
Sex Female 116 aor 75 47.8 
Male 100 46.3 82 52.2 
Race Asian 4 19 10 6.4 
Black 73 33.8 44 28.0 
Hispanic 78 36.1 65 41.4 
Multiracial 8 Det a 1.9 
White 53 24.5 35 we 
FRL Yes 157 pay 114 72.6 
No 59 213 43 27.4 
ELL Yes 50 23.1 39 24.8 
No 166 76.9 118 Pod. 
SpEd Yes 17 7.9 6 3.8 
No 199 92.1 151 96.2 
Students with MD 
Age in years M (SD) 12.74 (0.56) 12.79 (0.59) 
Sex Female 85 54.1 46 47.9 
Male 2: 45.9 50 52.1 
Race Asian 2 es 2 | 
Black 60 38.2 34 35.4 
Hispanic a7 36.3 38 39.6 
Multiracial 7 4.5 2 | 
White 31 19.7 20 20.8 
FRL Yes 120 76.4 78 81.2 
No 37 23.6 18 18.8 
ELL Yes 42 26.8 29 30.2 
No 115 TS), 67 69.8 
SpEd Yes 15 9.6 6 6.2 
No 142 90.4 90 93.8 
Teacher Information 
Sex Female i 63.6 é 77.8 
Male 4 36.4 2 22D, 
Race Asian 2 18.2 0 0.0 
Black 2 18.2 1 11.1 
Hispanic 0 0.0 1 11.1 
White i 63.6 7 77.8 
Experience* M (SD) 6.45 (5.28) 7.78 (5.83) 
Math courses M (SD) 4.45 (3.98) 7.00 (4.84) 


Note. * = years experience teaching math; SBI = schema-based instruction; FRL = students eligible 
for free or reduced priced lunch; ELL = English Language Learner; SpEd = students receiving 
special education services; Total student N = 373. 


Table 2. 


Descriptive Statistics for Measures by Treatment 


SBI Control Total 
n M SD n M SD n M SD 
Full Sample 
PPS pretest 210 9.08 4.13 154 10.74 4.72 364 9.78 4.46 
PPS posttest 208 12:53 5.60 150 11.74 4.77 358 12.20 5.27 
PPS delayed 197 11.99 5.00 143 11.96 4.95 340 11.98 4.97 
GMADE pretest 207 10.26 4.16 152 11.72 4.28 359 10.87 4.27 
GMADE posttest 207 12.28 4.45 148 12.43 4.37 355 12.34 4.41 
Students with MD 
PPS pretest 153 7.80 Ey 94 9.21 3.31 247 8.34 3.50 
PPS posttest 151 10.84 4.79 92 9.89 3.53 243 10.48 4.38 
PPS delayed 143 10.49 4.20 88 9.99 3.55 231 10.30 3.97 
GMADE pretest 149 9.49 3.80 93 10.43 3.62 242 9.85 3.76 
GMADE posttest 150 11.15 3.77 91 10.81 3.88 241 11.02 3.81 


Note. SBI = schema-based instruction; PPS = proportional problem solving; GMADE = Group Mathematics Assessment and Diagnostic 
Evaluation. All test statistics are based on the total number of items correct. 
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Table 3. 

HLM Results for PPS Posttest 

Full Sample Students with MD 

Fixed Effects B SE t df 2) B SE [ df 2) 
Between-Student Model 
Sex 0.40 0.397 1.01 326 313 0.13 0.478 0.27 224 .784 
Asian -0.51 1.079 = -0.47 326 .636 -0.57 1.884 — -0.30 224 .763 
Black -0.64 0.568 = -1.12 326 264 -1.06 0.687 ~~ -1.54 224 125 
Hispanic -0.84 0.526 = -1.59 326 12 -0.97 0.669 = -1.45 224 148 
Multiracial -0.25 1.163 = -0.22 326 .830 0.29 1.305 0.23 224 822 
Math Achievement Level 1.88 0.296 6.33 326 <.001 169 0.490 3.44 224 001 
Pretest 0.45 0.055 8.21 326 <.001 0.39 0.076 5.15 224 <.001 
Between-Classroom Model 
Intercept 12.78 0.641 11.24 0.880 
Treatment 225 0.444 5.07 13 <.001 1.82 0.573 Bal 12 .009 
Yrs. experience -0.02 0.047 ~— -0.47 13 .647 -0.02 0.065 = -0.26 12 802 
MKT IRT Estimate 13 0.424 3225 13 .007 1.39 0.564 2.46 12 .030 
Special education -0.13 0.318 = -0.39 3 .699 0.04 0.396 0.11 12 .916 
English language learner 0.25 0.319 0.78 13 449 0.08 0.413 0.18 12 857 
FRL -1.35 0.405 = -3.35 13 .006 -1.17 0.530 — -2.20 12 .048 
Random Effects VC SD Val df Dp VC SD xv df D 
Classroom 0.04 0.194 21.31 13 .067 0.20 0.451 21.32 12 .046 
Student 12.81 3.579 12.44 3.527 


Note. FRL = eligible for free or reduced price lunch; MKT — mathematical knowledge for teaching; VC = variance component. Here 


.10 
a=.05 for the test of the SBI effect and a saa for tests of the remaining fixed effects. 
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Table 4. 

HLM Results for PPS Delayed Posttest 

Full Sample Students with MD 

Fixed Effects B SE t df P B SE t df p 
Between-Student Model 
Sex 0.18 0.393 0.46 310 .644 0.03 0.456 0.07 213 947 
Asian -0.22. 1.058 ~— -0.21 310 835 -1.03 1.757 — -0.58 213 560 
Black -140 0.567 = -2.47 310 014 -1.67 0.648 = -2.57 213 O11 
Hispanic -1.05 0.518  -2.02 310 044 -1.37 0.626 = -2.19 213 029 
Multiracial -2.29 1.131 — -2.03 310 .043 -2.87 1.217 -2.35 213 .020 
Math Achievement Level oy 0.298 5.29 310 <.001 1.47 0.467 3.16 213 .002 
Pretest 0.37 0.055 6.71 310 <.001 0.27 0.070 3.85 213 <.001 
Between-Classroom Model 
Intercept 14.06 = 0.733 12.58 0.775 
Treatment 1.14 0.524 2017 13 049 Lay. > 0:511 229 2 041 
Yrs. experience -0.13. 0.055 = -2.29 13 .039 -0.12 0.057 = -2.07 12 .061 
MKT IRT Estimate 0.83 0.503 1.65 13 22 0.98 0.501 1.96 12 .074 
Special education -0.16 0.381 = -041 13 .688 -0.19 0.346 = -0.55 12 395 
English language learner 0.34 0.374 0.92 13 377 0.38 0.363 1.04 12 320 
FRL -1.51 0.472 ~~ -3.19 13 .008 -1.51 0.465 = -3.26 12 .007 
Random Effects VC SD xr df Dp VC SD vr df D 
Classroom 0.36 0.605 30.04 13 .005 0.02 0.127 17.69 12 125 
Student 11.88 3.446 10.91 3.303 


Note. FRL = eligible for free or reduced price lunch; MKT — mathematical knowledge for teaching; VC = variance component. Here 


.10 
a=.05 for the test of the SBI effect and a “agree for tests of the remaining fixed effects. 
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Table 5. 
HLM Results for GMADE Posttest 
Full Sample Students with MD 

Fixed Effects B SE t df 2) B SE [ df 2) 
Between-Student Model 
Sex 0.81 0.369 29 320 0.029 1.06 0.440 2.42 217 O17 
Asian 1s 0.993 1.15 320 0.250 Dog AGEL 1.73 217 084 
Black -0.34 0.533 -0.64 320 0.522 -0.19 0.645 — -0.30 217 .767 
Hispanic 0.16 0.488 0.33 320 0.742 0.41 0.617 0.66 217 510 
Multiracial -0.19 1.117. -0.17 320 0.865 0.42 1.244 0.34 217 .736 
Math Achievement Level 1.77 0.264 6.72 320 <.001 1.97 0.441 4.46 217 <.001 
Pretest 0.25 0.050 5.00 320 <.001 0.23 0.062 3.74 217 <.001 
Between-Classroom Model 
Intercept 13.31 0.661 12.62 0.880 
Treatment 1.06 0.466 2.28 13 0.040 0.88 0.568 1.55 2 147 
Yrs. experience -0.02 0.049 = -0.43 13 0.671 -0.05 0.064 ~~ -0.75 12 466 
MKT IRT Estimate 0.69 0.451 1.53 13 0.149 0.93 0.557 1.67 12 120 
Special education -0.61 0.343 -1.79 13 0.097 -0.48 0.403 -1.18 12 .260 
English language learner 0.15 0.340 0.43 13 0.673 0.15 0.410 0.37 12 718 
FRL -0.72 0.434 ~— -1.66 13 0.120 -0.89 0.536 = -1.67 12 121 
Random Effects VC SD xr df Dp VC SD rv df D 
Classroom 0.23 0.481 28.14 13 .009 0.37 0.610 27.18 12 .007 
Student 10.75 = 3.278 10.14 3.185 


Note. FRL = eligible for free or reduced price lunch; MKT — mathematical knowledge for teaching; VC = variance component. Here 


.10 
a=.05 for the test of the SBI effect and a “agree for tests of the remaining fixed effects. 


